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Abstract. We evaluate the potential of the CERN LHC collider to observe rare 
decays of the top quark in channels involving R-parity violating {Ijip ) interactions. We 
stress the importance of calculating top quark production and decay simultaneously 
as a true 2^4 process. 

The process of tt pair production followed by I^p decay of one of the top quarks is 
analyzed with fast detector simulation. We show that intermediate supersymmetric 
particles can be observed as resonances even if they are heavier than the top quark 
due to the significant off-shell top-quark mass effects. The approach where the top 
quark is produced on-mass-shell and then decays into 2- or 3-body final state would in 
general lead to incorrect kinematical distributions and rates. The rates of the 2^4 
process with top quark production and I^p 3-body decay depend on the total width of 
the heavy intermediate sfermion which could, therefore, be measured indirectly. 
We find that the LHC collider offers a unique potential to study rare top quark decays 
in the framework of supersymmetry with broken i?-parity for branching fractions of 
Ijip top decays as low as ~ 10^^. 
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1. Introduction 

Processes involving the top quark, the heaviest known fermion with a mass close 
to the scale of the electroweak symmetry breaking, offer a unique possibility to 
search for physics beyond the Standard Model(SM). It is well known that the SM 
suffers from fundamental problems such as hierarchy, fine-tuning, and absence of dark 
matter candidates. It is therefore believed that there must exist a more fundamental 
underlying theory. One of the most promising alternative models which resolves these 
problems is supersymmetry. The Minimal Supersymmetric extension of the Standard 
Model(MSSM), with the gauge group SU{3)c x SU{2)l x f/(l)y contains SM particles, 
their superpartners and an additional Higgs doublet. The MSSM possesses an additional 
discrete symmetry, called i?-parity {Rp ), which conserves lepton and baryon number: 



where B, L and S are the baryon number, lepton number and spin, respectively. 
However, there is no clear theoretical preference for the status of Rp - to be conserved 
or violated - in the supersymmetric theories. Therefore the answer whether the parity 
is realized in nature or not should be given by experiment. It is important to notice 
that I^p is much less constrained in general for the 3-rd fermion-sfermion generation 
compared to the first two generations. Therefore the CERN LHC collider, which can be 
considered as a top quark factory, plays a special role as a the perfect tool for testing 
the conservation of Rp in the top-stop sector. With tt production cross section of the 
order of 800 p6 [I], ~ 10^ top quarks will be produced per year, assuming an integrated 
luminosity of 100 fb~^. These high statistics will allow for precision measurements of 
top quark physics and in particular, for high sensitivity to rare top quark decays in a 
I^p scenario. 

Rare top-decays with I^p have been intensively studied for the last decade, and 
even before the discovery of the top quark |2] . If sfermions are light enough, the 2-body 
decay of top quark into fermion-sfermion pair will take place [HllllElinilZllHl ?, ?], 
otherwise the decay with a single neutralino (x^) (hereafter we are using x° notation 
for the lightest neutralino) in the final state proceeds with the kinematics of a 3-body 



The aim of the present paper is to take a closer look at I^p 3-body top quark decay 
expanding on previous studies in the following way: 

• we treat top quark production and decay coherently (i.e. calculate diagrams 
with off-mass-shell top quark) and show the crucial role of this approach for the 
predictions of kinematical distributions and production rates; 

• we perform a simulation of the processes at detector level, thus obtaining realistic 
predictions for the reach at the LHC. 

The outline of the paper is as follows: In Sect. 2, we evaluate production rates 
for the process pp —>■ tx^qi. We show that only by calculating together top quark 




(1) 



decay |Hlli. 
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production and decay do we obtain the correct cross section. We scan the /i — M2 
plane and present parton- level kinematical distributions. Sect. 3 gives details of the fast 
Monte-Carlo simulation, including the effect of initial and final state radiation, as well 
as hadronization effects, followed by the fast detector simulation. In Sect. 4, we describe 
the analysis procedure for extracting the signal from backgrounds and reconstructing 
the top quark and the slepton. In Sect. 5, we estimate the sensitivity of the LHC for 
observing of I^p top quark decays and we draw our conclusions in Sect. 6. 

2. Top quark production and decay: I^p scenario 

The I^p superpotential of the MSSM can be written as [121 HH IE] 

= \jkLiLjEk + X'iji^LiQjDk + X'-ji.U[DjDk + ^iLiH2, (2) 

where Li{Qi) and Ei{Ui, D,i) are the left-handed lepton (quark) doublet and right-handed 
lepton (quark) singlet chiral superfields; H2 is the second Higgs doublet field; /Xj are bi- 
linear I^p couplings; i, j, k are generation indices. Terms with A and A' coefficients violate 
lepton number while the term with coefficient A" violates baryon number. Lepton- and 
baryon- number violating operators together would lead to fast proton decay. It has 
been shown fHl ^1 that there exist symmetries that allow the I^p for the subset of 
these operators consistent with the limits on proton decay. Therefore, here we assume 
hereafter that the baryon-number violating operator is vanishing. The alternative case, 
with non-vanishing baryon-number violating operator but no lepton-number violating 
operator, leads to hadronic top quark decay, which is very difficult to observe due to 
the huge QCD background. 

The last bi-linear i?-parity violating (BRPV) term in the superpotential Q is 
responsible for spontaneous I^p violation. In general, it cannot be rotated away from 
the superpotential together with the SUSY soft breaking term by a suitable choice of 
the basis jTHI. If one tried to do this, then I^p terms would be reintroduced via two 
trilinear terms given by LLE and LQD in equation Q. Since our specific study of I^p 
involves only the top quark decay, the LQD I^p operator (precisely, LQ^D) is given by 
the second term of which also can effectively arise from BRPV term. It leads to the 
following Lagrangian in four- component Dirac notation: 

^I^p ~ Kjki^iLdkRdjL + djidkRl^iL + d*^j^{ViL)^ dji — 

eiidkRUjL - UjLdkReiL - dlL{eiL)'^UjL] + h.c. (3) 

Since we study I^p in the third family, only X'^^f. couplings are relevant. They give 
rise to top quark decay into a single neutralino via the Feynman diagrams shown in 
Fig. ^ Three kinds of virtual fermions can be present in the diagrams for non- vanishing 
X[^f.: a slepton, a squark of the first or second generation and a stop-quark. 

The decay width for this process of top-quark decay depends on: 
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Figure 1. Tree-level diagrams for three-body top quark decay into neutralino (x*'), 
lepton (1) and quark (q) via I^p operators. 

• The magnitudes of the neutrahno and chargino masses and couphngs, which are 
functions of the MSSM parameters. Assuming gaugino-mass unification, the U{1) and 
SU{2) gaugino masses Mi and M2 are related by Mi = |tan6'^M2, in which case the 
gaugino and higgsino masses and couphngs are determined by M2 - SU (2) gaugino 
mass, /i - superpotential Higgs mass parameter and tan (3. 

• The masses of the intermediate sfermion - squarks and sleptons - which could be 
either lighter or heavier than the top-quark. 

We assume here for simplicity the case where one sfermion, for example, a slepton, 
is lighter than any other intermediate sfermions, i.e. it gives the leading contribution to 
the I^p decay of the top quark. For our calculations we have used CompHEP v33.23 [T7] 
together with a fully implemented model of I^p (EqUJ interactions [TH]. Contours of 
the partial width, Ttop-, for top decay by the channel t X^iq in the (/i — M2) plane are 
shown in Fig. |21 The partial width was calculated as in jU] . 
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Figure 2. Contours for the partial 3-body top decay width Ttop[t — > X^^^q] for a 
slepton mass mj = 200 GeV 



The decay width decreases as M2 increases since the neutralino mass increases 
with this parameter. The cross section of the complete 2 — 4 process gg tx^iq 



Signals from R-parity violating top quark decays at LHC 5 

describing tt production and I^p decay of one of top quarks can now be evaluated. The 
corresponding diagrams are shown in Fig. El 
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Figure 3. Tree-level diagrams for the gg 
due to interactions 



tx iq process of tt production and decay 



For the parton-level calculations, we used the CTEQ5L [12] parton density function 
with the top quark mass as the QCD scale. In order to avoid soft and collinear 
divergences when massless quarks are present in the final state, we applied a quark 
transverse momentum cut, pj^ > 10 GeV. Diagrams (1-3) in Fig.^lform a gauge-invariant 
subset which does not require the pj- cut. However, the total set of subprocesses leading 
to tx^iq state consists of 8 Feynman diagrams which should be calculated together. 

In Fig. m we plot the cross section for the process gg tx^iq as a function of the 
slepton mass under three approaches: 

(i) gg ^ tt X Br[t —>■ qi] x Br[£ ix^] (m^- < rritop) or gg ^ tt x Br[t —>■ qix^] 
{rrif > rritop) ■ Here, the top quark undergoing I^p decay stays on-shell 

(ii) contribution of diagrams (1-3) only 

(iii) complete calculation of the process gg tx'^iq, i.e. calculations of the set of 
diagrams (1-8). 

One can see that the cross section evaluated in approach (i) agrees within 30-50% 
with those of (ii) or (iii) when < rritop- On the other hand, when > rritop 
approach (i) underestimates the true cross section of approach (iii) by about an order 
of magnitude! Rates predicted by approach (ii) are about a factor of 2.5 smaller 
compared with those of approach (iii). To understand the origin of the difference between 
approaches (i) and (iii), we studied kinematical distributions. Fig. Elshows the x^i (top) 
and x^iq (bottom) invariant mass distributions for the complete calculation of (iii). 

Even for a quite heavy slepton ( = 200 GeV ), the resonant peak from the 
slepton in x^i distribution is clearly seen. This means that the slepton forces the top 
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Figure 4. Cross section of gg tx^lq process as a function of the slepton mass for 
the 3 approaches (see text). 



quark to be off-shell and becomes the resonance itself. The contribution from the on- 
shell heavy slepton is significant. In approach ii.) the distribution is similar, but 
the slepton resonance peak is slightly suppressed. 

The q}(^^ invariant mass distribution (bottom of Fig. Ej) in the top quark decay 
is sensitive to the mass of the intermediate slepton. For a heavy slepton > mtop, 
the top quark resonance peak is strongly suppressed and a right shoulder appears in 
the invariant mass spectrum. This happens because the heavy slepton "pushes" 
the top quark to be off-shell and becomes itself on-shell. In this case, the experimental 
reconstruction of the top quark mass is more difficult due to this shoulder. On the 
contrary, if the slepton mass is less than the top quark mass, two-body top quark 
decay takes place and one can observe a pronounced peak in the Ix^q invariant mass 
distribution. 

We have explicitly checked that total cross sections for approaches (i), (ii) and (iii) 
agree fairly well (at about 20% level) after the application of a 20 GeV mass window 
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Figure 5. Parton- level x'^i invariant mass distribution (top) and x'^iq invariant mass 
distribution{bottom) for different slepton masses. 



cut on £x^ invariant mass to remove the contribution from the slepton. 

Another difference between the predictions of approaches (i) and (iii) must be 
pointed out. In Fig. one can see that the I^p top decay width decreases with an 
increase of the M2 parameter. Therefore, in approach (i), the cross section for the 
99 ~^ tX^^I process also decreases as M2 increases. The situation is just the opposite 
in approach (iii), because the cross section of the true 2 — > 3 process also depends on 
the slepton width. In Fig. IHl one can see that the cross section increases with M2 due a 
decrease of the slepton width. 
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For the rest of the analysis, we use approach (iii) which gives the correct cross 
section and kinematical distributions. 

One should also note that we treated neutralino as an on-shell particle. It decays 
through the intermediate sparticle, which could also, in principle, "push" a neutralino to 
be off-shell and invalidate the on-shell approach for the neutralino. However one should 
recall that neutralino width is at least several orders of magnitude smaller than the width 
of the intermediate scalar (~ 10"^ - 10"* GeV for A ~ 0.1 - 0.2 and m-j ~ 100 - 200 
GeV). tl This fact eliminates the probability for the intermediate sparticle to be on-shell 
for the x° ~^ ^^(^^t) ~^ dq chain. The asteriks here denotes an off-shell intermediate 
sparticle. We have checked this qualitative argument numerically and have calculated 
the width and mass distributions for the t d{i+) ^ ^^i^*) ^ dq process for 

true 1 — >• 5 top quark decay. We have chosen m;-=150 GeV and have found that, indeed, 
the invariant mass distribution of the Idq system from — >• — > dq process, has 
a delta-function-like shape and the exact width for the 1-^5 top quark decay can be 
accurately (within numerical errors of 1%) reproduced by product of the 1—^3 top 
quark decay width and the neutralino branching ratio. This validates the treating of 
neutralino as on-shell particle and suffices dealing with 3-body top decay. 

In the next section, we perform a fast Monte Carlo simulation of the gg tx^iq 
process in order to estimate a realistic experimental sensitivity to I^p top quark decay. 




-300 -200 -100 100 200 300 -300 -200 -100 100 200 



H.GeV H.GeV 

Figure 6. Contours for the cross-section of gg ty^iq process for = 150 GeV 
(left) and = 200 GeV (right). 

In principle, the neutralino width could be comparable with the width of a slepton, when the x\ ^ tt 
2-body decay channel becomes open if mj > to^ > mt- But such case is not relevant to our study since 
in this scenario the RPV top-quark decay branching ratio will be several orders (~ 3 — 4) of magnitude 
below the sensitivity of the LHC. 



Signals from R-parity violating top quark decays at LHC 



9 



3. Signatures and details of simulation 

We have used the CompHEP package to generate ti events with I^p decay of one of the 
top-quarks — t — * x'^qi and SM decay of the other one — t — > Wb. We have studied 
the cases of hadronic and leptonic decay modes of the VT-boson from the top-quark 
undergoing the SM decay. In case of the leptonic decay of W, we studied W ^ fiu 
decay channel in order to enhance the separation between the top I^p SUSY and SM 
decay chains. 

In the present study we assume that only one X[^i^ parameter in Eq. (3) is non- 
vanishing. A value of 0.5 for was chosen for a reference. The following values 
of supersymmetric parameters were used: a gaugino mass M2 = 120 GeV, a higgsino 
mass parameter /i = —300 GeV, tan(3 = 10, and a slepton mass either = 150 GeV 
{mi < rritop) or 200 GeV (m^- > rritop). Under these conditions, the total cross-sections 
obtained with CompHEP for the 2^4 signal process (see Fig. El pf^ > 10 GeV) are 
8 pb for a slepton mass =150 GeV and 480 fb for = 200 GeV. This is to be 
compared with the total cross section of 833 pb [T] for the tt background. 

With this set of parameters, the mass of the neutralino is m^o = 58 GeV. If is 
non-zero only for i = k = 1, the neutralino will decay into z/gM or z/gM (BDN) (Fig. [7j). 

We also consider the possibility of stop-scharm mixing leading to neutralino decay 
into i~cd or i~^cd (Fig. It must be pointed out that such mixing, leading to 
flavor changing neutral currents (FCNC), is practically not constrained by experimental 
data fK)\ E] • We assume maximum stop-scharm mixing here, but the results can be 
easily rescaled for any arbitrary value of the mixing. If the stop-scharm mixing is 
significant, and if one of the stop quarks is lighter than other sfermions appearing in 
the Feynman diagrams, then the cde{cde) (CDE) channel could be dominant. In 

this case, one would be able to obtain with much higher efficiency ( in comparison to 
BDN case ) a narrow peak for the reconstructed top quark mass. 

An additional advantage of this decay mode is that the neutralino, by virtue of 
its Majorana nature, decays equally to positively and negatively charged leptons. This 
means that half of all events would contain two like-sign leptons. This clean signal 
signature allows the application of an effective cut to suppress possible backgrounds. 
The study of the I^p rare top decays at the LHC would also allow the direct measurement 
of, or the establishment of a limit on stop-scharm mixing. Below, we perform an analysis 
under both assumptions for neutralino decay: with and without stop-scharm mixing. 

PYTHIA 6.2 [22] was used to account for initial and ffnal state radiation and to 
perform hadronization and decay of resonances. The Lund symmetric fragmentation 
function has been used for light ffavors, but charm and heavier ones - according to the 
Peterson/SLAC function. The simulation of the signal and background was performed 
with ATLFAST j2Hl to take into account the experimental conditions prevailing at LHC 
for the ATLAS detector pi]. 

Jet energies were reconstructed by clustering hadronic calorimeters cells of 
dimensions Arj x A0 = 0.1 x 0.1 within the pseudorapidity range —2.5 < r] < 2.5, where 
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Figure 7. Tree-level diagrams for MSSM x° i>ebd{vebd) decay. 
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Figure 8. Tree-level diagrams for FCNC x° ^ cde{cde) decay, 
is the azimuthal angle. The hadronic energy resolution of the ATLAS detector is 



parametrized as 0.5/ y E{GeV) (BO. 03 over this rj region. Hadronic showers are regarded 
as jets if its deposited transverse energy Et is greater than 10 GeV within a cone of radius 
AR — 0.4. Electromagnetic calorimeters cells of dimensions A77 x A0 = 0.025 x 0.025 
within the same pseudorapidity range —2.5 < 77 < 2.5 are used to measure the lepton 
energy. The electromagnetic energy resolution is given by 0.1/^/E{GeV)®0.007 over 
this rj region. Electromagnetic showers arc identified as electron candidates if their 
Et > 5 GeV within a cone of radius AR = 0.15. Default ATLFAST electron isolation 
criteria were applied: separation by AR > 0.4 from other clusters and Et < 10 GeV 
deposition in AR = 0.2 cone around the electron). Default selection criteria for muons ( 
Pt > 6 GeV and \rj\ < 2.5 ) and isolation criteria, the same as for in the case of electron, 
were also applied. 

ATLFAST labels a jet as a 6-jet if a 6-quark is present in a cone AR — 0.2 around 
the reconstructed jet for jets with rj < 2.5. Efficiencies for b-jet tagging have been 
parametrized by Pt -dependent functions, with maximal saturated efficiency 65 = 0.7 
at high Pt . We have checked that for slepton mass within the range 100 — 1000 GeV 
and A' > 0.005, the lifetime of the neutralino is shorter than the lifetime of a B-meson. 



1 
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Therefore displacements of the B-meson vertex due to the neutrahno decay will not 
affect the b-tagging efficiency. 

The analysis transverse momentum cuts used for electrons, muons and jets were 10 
GeV, 10 GeV and 20 GeV, respectively. 

4. Signal and background analysis for ode channel 

In this section we study CDE neutralino decay channel: ode. First we analyze 

kinematical characteristics of jets for this channel. The partonic distributions of 
the transverse momentum and pseudorapidity of quarks and leptons for the process 
PP ~^ ^ cde) are shown in Figs. El CHI IH] and [T21 For completeness, we also 

show distributions for jets originating from W — > jets decay from top-quark undergoing 
SM decay mode. 




100 200 300 400 100 200 300 



quark P^.GeV quark P^.GeV 

Figure 9. Transverse momentum of quarks from the pp ty^qi reaction ( CDE 
channel ) for mi = 150 GeV (left) and — 200 GeV (right ). (T) means a quark 
originating from a top quark decay, whereas (N) denotes its origin from a neutralino 
decay and (W) from the W decay. 

The transverse momentum spectra of quarks in the process involving a light slepton 
{mi = 150 GeV) (Fig. El^left)) indicate that the highest Pt jet in the event, with Pt 
> 50 GeV is a 6-jet from the top quark SM decay. Using 6-jet tagging technique this jet 
can be effectively separated from the analysis. Among jets of Pt < 50 GeV, a (i-quark 
from the I^p top quark decay dominates, as well as in the very high P^ region. For the 
case of a heavy slepton (m^- = 200 GeV) , a ci-quark from I^p decay tends to be with the 
highest Pt in the Pt > 150 GeV region and to be emitted in the forward direction (see 
Fig- El right)). The two jets with smallest Pt in the events, originate from a neutralino 
decay. 

The transverse momentum for a lepton from I^p top quark decay is the largest in 
the region Pt > 50 GeV and Pt > 75 GeV for the light and heavy slepton set of events. 




quark y] quark y] 

Figure 10. Pseudorapidity of quarks from the pp tx^qi reaction for = 150 GeV 
(left) and = 200 GeV (right). The notations are the same as in Fig. |51 

respectively (see Fig. ITT|) . In terms of the pseudorapidity variable, leptons are mainly 
emitted in the central region (Fig. IT^. 
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Figure 11. Transverse momentum of leptons from the pp — + tx^qt reaction for 
mi — 150 GeV (left) and = 200 GeV (right). (T) means a lepton originated 
from the top quark decay, whereas (N) denotes its origin from the neutralino decay 
and (W) from the W decay. 

The effect of initial (ISR) and final state (FSR) QCD radiation approximately 
doubles the number of jets with Pt > 10 GeV produced in the event. Fig. IT^ shows the 
jet multiplicity distribution. 

The only non-negligible background for the CDE channel is tWW{q) processes. 
This process would be a background for the case where x° cde when both W's decay 
leptonically and the W from the top quark decays hadronically. The Feynman diagrams 
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Figure 12. Pseudorapidity of leptons from the pp tx^q£ reaction for — 150 GeV. 
The notations are the same as in Fig. 1111 
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Figure 13. Distribution of the number of reconstructed jets after ATLFAST for the 
cases oiW ^ niy (left) and W — > jets. 



for tWWq background are shown in Fig. EI The total cross-section for this process, 
obtained from CompHEP is 1.1 pb. 

5. Results for cde channel 

The following cuts have been worked out for the top quark reconstruction: 

• At least 4 ( or 6 for t bjj final state ) jets with Pt > 20 GeV and one electron 
with Pt > 10 GeV within \ri\ < 2.5 pseudorapidity. 

• one jet tagged as a 6-jet: required to get rid of a 6-jet from a top quark which 
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Figure 14. Tree-level diagrams for the tWWq process 

decayed in the framework of the SM. 
• cut on invariant mass of (jjee), M{jjee) < 150 GeV (for the hght slepton case) or 
< 200 GeV (for the heavy slepton case), to suppress the influence of the on-shell 
slepton on the top quark signal, especially effective in the < rritop case. 

For the mass reconstruction we combine two electrons with the three jets in the 
event. If the number of jets in the event was larger than three (but less than seven), 
the three jets with the smallest Pt in the event were combined with both electrons. 

The resulting mass distributions of the (jjjee) system are shown in Fig. for the 
two different W decay modes studied and the light slepton case , = 150 GeV (left), 
and the heavy one, = 200 GeV (right), respectively. The data are presented for an 
integrated luminosity of 100 fb^^ (one year of running at high luminosity at LHC) for 
the light slepton case, and 300 fb^^ for the heavy slepton case. After the fiducial cuts 
given above, the tWWq background for the events with x° — >• cde is appears to be very 
small and practically is not seen on the Fig. ^1 

The events for the heavy slepton case show the shift of the mass value of the 
top quark signature because of a heavy on-shell slepton mass dominance and big 
combinatorial jet pairs background. 

Based on the kinematical distributions shown above, we define procedures to select 
and reconstruct the neutralino and the slepton in the events of interest. 

For the case of a light slepton, in order to reconstruct the neutralino (Fig. E[ left), 
we combine the electron with smallest Pt with the two jets with smallest Pt ■ The figure 
shows the invariant mass distribution for an integrated luminosity of 100/6^^, with the 
contributions from events where W ^ fiu and where W —>■ jets explicitly indicated. 

For the heavy slepton case (Fig. UHl right) we use the same procedure, but due to 
a lower production cross-section, we present the mass reconstruction for an integrated 
luminosity of 300/6~^. 

For the reconstruction of the slepton, we combine both electrons in the event with 
the same two soft jets (Fig. ITTjl. 
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Mass(jjjee), GeV Mass(jjjee), GeV 

Figure 15. Detector level invariant mass distribution for the (jjjee) system in CDE 
channel and light (left) or heavy (right) slepton cases (see text). The distributions are 
normalized for an integrated luminosity of 100/6^^ and 300/6^^, respectively. 




Figure 16. Detector level invariant mass distribution for the (jje) system for CDE 
channel and the light slepton (left) or the heavy slepton ( right) cases. The distributions 
are normalized for an integrated luminosity of 100/6^^ and 300/6^^, respectively. 



Light slepton case presented in Fig. [T7| (left). 

For the heavy slepton case (Fig. [T21 right) we use the same procedure, but again 
due to a lower production cross-section, we present the mass reconstruction of sleptons 
for an integrated luminosity of 300/6^^. 
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Figure 17. Detector level invariant mass distribution for the (jjee) system for 
cde and the light slepton (left) or the heavy slepton ( right) cases. The 
distributions are normalized for an integrated luminosity of 100/6~^ and 300/6~^, 
respectively. 



6. Results for x° bdu channel 

In the case where x° bdu, we considered only the scenario where W decays into jets, 
since the decay mode W ^ ui leads to two neutrinos in the final state, making the 
event reconstruction difficult. Fig. 1181 shows the partonic distributions of the transverse 
momentum of quarks for events where the neutralino decays x° bdulnght). 

Thus, we are led to event topologies with 6 quarks, one electron and a neutrino 
at the parton level. Although the large combinatorial background in jet pair selection 
makes it difficult to reconstruct the signal for the event under study, one can observe 
certain correlations in these distributions. For example, the two softest light jets are 
originating from a neutralino. 

The natural background for the case where x° ~^ bdv is tt and, possibly, tthb 
production. These backgrounds have the topology of the signal when one P^-boson 
decays into jets and the other W decays leptonically to eu. 

We applied the following selection cuts for reconstructing events where one top 
quark decays via the I^p SUSY mechanism, and its decay product, a neutralino, decays 
to hdv, while the other top quark in the event, decays in the SM to a 6 quark and two 
jets. 

• at least 6 jets with Pt > 20 GeV and one electron with Pt > 40 GeV and \ri\ < 2.5 
(see FigHH). 

• at least two jets tagged as b-jets with Pt > 20 GeV: one for the top quark with 
the SM decay and another from the decay of the neutralino. 

• No two-jet combination should have the invariant mass of a W, in a window ±20 
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Figure 18. Transverse momentum of quarks from the pp — > tx'^qi reaction for 
— 150 GeV wiiere ~* bdv. (T) means a quark; originated from a top quark 
decay, whereas (N) denotes its origin from a neutralino decay and (W) from a W 
decay. 

GeV. 

• cut on the mass of the system {ehu) < 140 GeV (see Fig lT^ . to suppress the tt 
background, since no such decays of the top quark should occur in the I^p top decay 
scenario. 

• cut on the transverse mass of {jjeu): M{jjeI^T) < 150 GeV (for the hght slepton 
case ) to suppress the influence of the on-shell slepton on the top quark signal, 
especially effective in the < nitop case. 

The mass reconstruction was performed for one electron, and three jets in 
the event. When the number of jets in the event was larger than three (but less than 
seven), the three jets with the smallest Pt in the event were taken into the reconstruction 
system. 

The resulting mass distributions are shown for the {jjjeu) system in Fig. Onf left) 
for x° hdv decay channel and the light slepton case(m^ = 150 GeV). The data 
are presented for an integrated luminosity of 100 fb^^. The distributions for signal 
and background are shown with separate contributions from tt and tthb events. The 
generation of the tthb background has been performed with CompHEP and the cross- 
section obtained was 5.44 pb. As one can see below, this background brings contribution 
of about 2% to the total background for all signal signatures considered. 

For the heavy slepton case (m^ = 200 GeV) we present our results in 
Fig. I^UT rightlfor the signal events only for an integrated luminosity of 300/6~^. Bearing 
in mind the large ti background for x° — > hdv, it is clear that no signal can be extracted 
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of electron, GeV Mass (e V b), GeV 

Figure 19. Parton level transverse momentum of electron produced in I^p top decay 
(solid line) and in VF-boson leptonic decay in ti events (dashed line) (left); Detector 
level invariant mass distribution for (evb-jet) system in the I^p top decay events with 
a neutralino decay to bdv (solid line) and ti events (dashed line ) (right). 



for the BDN channel and the heavy slepton case. We do not show for this case the 
distributions for backgrounds due to their overwhelming dominance. 



500 



300 



200 - 





t - 


edx 


edbdi^ 




[ V 












tt 








tfbb 



100 



200 



300 400 
Mass(jjjev), GeV 




300 400 
Mass(jjjev), GeV 



Figure 20. Detector level invariant mass distribution for the [jjjev) system for 
7112 ~ I'^O GeV (left) and = 200 GeV (right) cases for x° hdv decay 
channel. Simulations were done for an integrated luminosity of 100/5~^ and 300/6~^, 
respectively. The background of tl. and tibb production for = 150 GeV case is 
presented. 



For these events to reconstruct the neutralino, we combine the^T with the two jets 
with smallest Pt , and for the slepton, we combine the same two jets with the softest 
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electron and the ■ The shift from nominal simulated values for the neutralino ( 60 
GeV ) and the slepton ( 150 GeV ) is due to the difficulties to calculate the energy of 
neutrino. 
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Figure 21. Detector level invariant mass distribution for the {jji') (left) and [jjev) 
(right) systems for the case mi = 150 GeV and x° hdv. Background of ti events is 
also shown. The distributions are normalized for an integrated luminosity of 100/6""'^. 



The relative strengths of signal (x'' — * hdv) and the tt background are compared in 
Figs. |2ni;ieft) andini 

For the heavy slepton case we use the same procedure, but due to a lower production 
cross-section the signal cannot be seen due to the tt background dominance. 

It is worth to mention that the accuracy of the tt background measurement for 
the BDN decay channel would be very important. An error of 1% on the top quark 
mass measurements corresponds to an error of 5% on the total ttbar cross-section, or 
vice versa. Systematic uncertainties of the measurements of the top quark mass are 
dominated by the jet energy scale and FSR effects. Assuming a 1% scale uncertainty, 
which is feasible in ATLAS, and varying the jet cone size, should reduce the total 
systematic uncertainties[?]. The precision of the measurements of the total tt cross- 
section is expected also to be dominated by the knowledge of the absolute scale of the 
luminosity. In any case, the significant amount of data will be required before the tt 
background contribution can be estimated accurately. 

6.1. LHC reach 

Our final results are presented in Tables [H |21 and El and Fig. |221 

Tables n and 121 present signal and background cut efficiencies (e*^-^^ and e^^^) ) for 
the channels ~^ cde and x° bdu channels, respectively, for the light slepton case. 
The cuts were optimized such that ef^^^i/eg^j^g^^^^^ ~ 12, while efi^„^;/e£^4^„„„d ~ 
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7.1(5.6) for leptonic (hadronic) decay channels for VT-boson. For the heavy slepton case 
the ^'ti^nail ^backqround ^atio IS similar to the one for the light slepton case. 



Table 1. Effective cuts and respective efficiencies (e (%)) for the signal events with 
X° — > cde. 

X'^^cde t^WWj x'^^cde t^WWj 
W ^ liu BG W^2jets BG 



Number of events 










L = 100 fb-^ 


86012 


67 


538369 


417 


Cuts used: 


6(%) 


6(%) 


e(%) 


e(%) 


2 leptons 


49.46 


59.21 


47.93 


57.32 


2 leptons + 4 jets 


36.29 


21.50 


17.98 


8.61 


1 b—jet tag 


19.46 


9.65 


9.40 


3.44 


M,/ep<150 GeV 


3.53 


0.50 


1.90 


0.34 



TableElgives the number of expected events, calculated for an integrated luminosity 
of L = 100/6~^, for the channels CDE and BDN and for the light slepton mass 
mi = 150 GeV. For the heavy slepton case, i.e. = 200 GeV we only present in 
parentheses the numbers only for the CDE case, since the BDN case is hopeless in 
view of the dominant it background. 

As can be seen from this table, the CDE signature has negligible background for 
both hadronic and leptonic W decay channels. The BDN channel, on the contrary, has 
much larger background coming from SM tt events. Nevertheless, the it is effectively 
suppressed by the fiducial cuts, and the S/ \fB ~ 50 for the case of a light slepton. 



Table 2. Effective cuts and respective efficiencies (e (%)) for the signal events with 
X° hdv. 





— » bdv 


tt 


ttbb 




W 2jets 


BG 


BG 


Number of events at 








L = 100 fb-^ 


538576 


6100000 


535000 


Cuts used: 


e(%) 


e{%) 


6(%) 


Cuts used: 


1 lepton 


61.81 


45.53 


48.08 


6 jets + 1 lepton 


24.22 


5.34 


30.88 


2 b-jet tags 


7.17 


2.17 


10.72 


M(e.fe) < 140 GeV 


3.57 


0.53 


2.00 



Msiep <150 GeV 1.12 0.09 0.30 
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Table 3. Number of expected signal events for CDE{y^ cde) and BDN{x^ hdv 
channels for an integrated luminosity of L = 100/6^^. Background (BG) presented 
are: tWWq events for x° cde case and ti +ttbb production for x° hdv sample of 
signal events. Heavy slepton case for the CDE channel is given in parenthesis. 



Signal 


Mass 
window 
(GeV) 


Signal 
events 


BG 


Signal 
events 


BG 


Signal 
events 


BG 






X° cde 




X° — ^ cde 




— > bdu 








W ^ fiu 




W^2j 








top quark 


175 ± 10 


949 (-) 


0.1 (-) 


2526 (-) 


0.3 (-) 


1683 


1150 




175 ± 20 


1535 (-) 


0.1 (-) 


4389 (-) 


0.5 (-) 


2954 


2138 




175 ± 30 


1876 (-) 


0.1 (-) 


5588 (-) 


0.7 (-) 


3835 


2882 


neutralino 


60± 10 


1991 (88) 


0.2 (0.5) 


6738 (182) 


0.9 (0.9) 


3415 


2551 




60 ±20 


3602 (149) 


0.4 (0.9) 


12433 (294) 


1.8 (1.6) 


6346 


5172 




60 ±30 


4906 (199) 


0.6 (1.3) 


17325 (390) 


2.7 (2.4) 


8558 


7874 


selectron 


150 ± 20 


3985 (141) 


0.4 (0.7) 


13208 (375) 


1.5 (1.8) 


6253 


8079 




150 ± 30 


5330 (194) 


0.5 (1.0) 


18130 (537) 


2.2 (2.7) 


8503 


11399 



150 ±40 6278 (240) 0.7 (1.4) 21786 (677) 2.9 (3.5) 10112 13969 



The sensitivity of the LHC to A' mainly depends on the slepton mass, /x, M2 and 
tan (3 which define the top I^p decay branching ratio. For our particular choice of these 
parameters, we estimate the potential of the LHC to measure A' coupling by studying 
the significance S/ \fB versus A' for both cases of neutralino decay presented in Fig. l22l 
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Figure 22. S/VB vs A' for CDE{Mt) and BDiV(right) channels. For W ^ fiv 

decay channel the data are presented for events with = 150 GeV ( solid line ) and 
mi = 200 GeV ( dashed line ). 
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One can see the apparent advantage of the FCNC channel x'^ — > cde which allows 
the determination of the exclusion limits on A' > 0.006 ( A' > 0.03 ) at 2a CL or even 
the possibility to observe the signal at 5a CL for A' > 0.01 ( A' > 0.05 ) for light (heavy) 
slepton case. The case with the SM top—* bjj is more promising since it provides more 
statistics. One should remember that we have assumed the maximal stop-scharm mixing 
(V^) in our analysis. Therefore the hmit on A' presented above should be understood 
as the hmit on A' x V^^. 

For the BDN channel, the sensitivity to A' is significantly reduced: A' > 0.15 at 
2(7 CL for the hght slepton case. For the heavy slepton case the BDN channel is not 
observable. 

The limit on A' depends on several SUSY parameters. To reduce the model 
dependence, it is much more convenient to present the results in terms of limits on 
the branching fraction of I^p top quark decay - BFU = BF(t qx^^)- For the light 

slepton case, the LHC is sensitive to BF%i >3 x 10~^ for the CDE channel and to 

BFL >2 X 10"^ for the BDN channel at 2a CL. 

In the case of a heavy slepton scenario, the LHC is sensitive to BFl^ >3 x 10"^. 

It looks strange that the LHC is much more sensitive to BFi^ in the heavy slepton 

case. The puzzle is hidden in the formal definition of BFp — BF{t — > qx^'^) which 

jfp 

assumes that BFi^ is calculated for the on-mass-shell top-quark. However, for the 
ifp 

heavy slepton case there are strong off-mass-shell top-quark effects and, therefore, it is 

more convenient to define BFt^ as a ratio of I^p and SM cross sections of the top- 

ifp 

quark production and decay. For this definition, light- and heavy-slepton case limits 

are consistent with each other and for heavy slepton one has the BFp limit of about 

ifp 

5 X 10~^ i.e. a httle bit worse than for the hght slepton scenario. 

It is a quite generic and quasi model independent fact that the sensitivity of the 

LHC to BFL is of the order of 10"^ for CDE channel while for BDN it is about three 
i^p 

orders of magnitude worse. 
7. Conclusions 

We have studied the sensitivity of the CERN LHC collider to rare I^p top quark decay. 
We have shown that it is very important to consider top quark production and its I^p 
decay together (approach (iii) defined in Sect. 2) in order to obtain the correct cross 
section rates and relevant distributions. The necessity of this treatment is related to the 
fact that the I^p top quark decay involves a heavy intermediate sfermion which forces 
the top quark to be off- shell. 

Our studies have been done at the detector fast simulation level. We have shown 
that the LHC collider offers a unique potential to study rare top quark decays within the 
framework of supersymmetry with broken i?-parity with a sensitivity on the branching 



Signals from R-parity violating top quark decays at LHC 



23 



fraction -BFL of the R-parity violating top quark decay in the range of~10 ^ — 10 ^ 

for the CDE channel and ~ 10~^ for the BDN channel. 

We have shown that the CDE channel is not only very sensitive to the A' coupling, 
but will also allow the measurement (or the setting of a limit ) on the c — t mixing which 
is practically unconstrained, at present. The BDN channel can provide an independent 
limit on the A' coupling, irrespective of the squark-mixing parameter. 
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